Cavity analysis on the robustness of random networks against targeted attacks: 

influences of degree-degree correlations 
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We developed a scheme for evaluating the size of the largest connected subnetwork (giant compo- 
nent) in random networks and the percolation threshold when sites (nodes) and/or bonds (edges) 
are removed from the networks based on the cavity method of statistical mechanics of disordered 
systems. We apply our scheme particularly to random networks of bimodal degree distribution 
(two-peak networks), which have been proposed in earlier studies as robust networks against ran- 
dom failures of site and/or targeted (random degree-dependent) attacks on sites. Our analysis 
indicates that the correlations among degrees affect a network's robustness against targeted attacks 
on sites or bonds non-trivially depending on details of network configurations. 

PACS numbers: 89.75.Fb, 02.50.-r, 84.70,+p 
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I. INTRODUCTION 

In the last decade, much research has been done on 
the regulation of connectivity of networks |l]-|f| . The In- 
ternet, electric power grids, and airline routes are exam- 
ples of real-world networks, for which the connectivity 
is demanded to resist various failures of nodes and/or 
links connecting the nodes. Preventing epidemics from 
spreading extensively in human/ animal networks is an- 
other example of the regulation of network connectivity, 
for which, in contrast, reduction in the connection effi- 
ciency is required. 

Erdos-Renyi-type random networks (graphs) || [tJ 
and their derivatives provide research for the above- 
mentioned purposes with useful test beds. A basic ran- 
dom network is generated by connecting any pairs of sites 
(nodes) with a probability of p. The degree, which repre- 
sents the number of bonds (edges) by which a site is con- 
nected directly to other sites, follows a Poissonian distri- 
bution, for which frequencies of large degrees that consid- 
erably deviate from the mean are practically negligible, 
in the case of the basic random network. However, real- 
world data indicate that there exist significantly many 
nodes of large degrees in the Internet, which is often 
modeled by a scale-free network, where the degree distri- 
bution is characterized by a power-law form p{k) oc k~ a 
of an appropriate exponent a. 

Besides the degree distribution, there are several ma- 
jor feature quantities for characterizing network configu- 
rations. A naive generalization from the notion of the de- 
gree distribution may be the degree-degree correlation (or 
degree correlation), which represents the tendency of how 
likely sites of many bonds are to be connected to other 
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sites of many or few bonds. The following two quanti- 
ties are also widely used. One is the average path length, 
which represents how many sites are at least necessary to 
follow a path between two randomly chosen sites. Ran- 
domly constructed networks typically have much shorter 
average path lengths than those for Cartesian lattices [|j . 
The other is the so-called clustering coefficient, which 
denotes the probability that a randomly chosen pair of 
sites, which come from the same particular site, is also 
connected. In our daily life, this implicates the tendency 
that two randomly chosen friends of a particular person 
are friends with each other as well fi 10 . 

Several earlier studies characterized the robustness of 
network connectivity using feature quantities, which orig- 
inated in research on percolation phenomena [|ll| . Cohen 
et al. assessed the percolation threshold with respect 
to random removal of constituents on random networks, 
which was used for arguing the robustness of scale-free 
networks Q|. The method of generating function offers 
one of the most powerful techniques for such analyses. 
Based on this technique, Newman et al. developed sys- 
tematic schemes to compute the size of the largest sub- 
network, which is occasionally termed the giant compo- 
nent, the percolation threshold, the average path length, 
etc. for random networks with arbitrary degree distri- 
butions |l2). They clarified that scale- free networks are 
highly robust against random removal of sites and, in par- 
ticular, scale-free networks of a > 3 do not disintegrate 
unless all sites in networks break down. Newman also 
explored the effects of the degree correlation in random 
networks []l3j, and Golstev et al. gave detailed consid- 
eration on how it affects the percolation threshold [ [l4| . 
They showed that so-called assortative mixing random 
networks exhibit higher robustness than those without 
degree correlations |1^, [l(|. The details are mentioned 
in the following sections. Some researchers investigated 
not only the robustness against random failures but also 
the effects of targeted attacks, the terminology of which 
is used for referring to random dcgrcc-dcpcndcnt attacks 
throughout this paper, on sites on random networks |j~7| - 
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|19| and designed robust networks against various failures 
by optimizing the network configurations ||(], Va- 
lente et al. and Paul et al. [^3| showed that ran- 
dom networks characterized by degree distributions of 
two or three peaks are most robust against targeted at- 
tacks and/or random failures. 

Along this research direction, we mainly explore ro- 
bustness of networks against targeted bond attacks. More 
precisely, we particularly examine random networks of 
bimodal degree distributions (two-peak networks) which 
are the most robust against site attacks. For this, we will 
develop an analytical scheme based on the cavity method, 
which was originally developed in statistical mechanics of 
disordered systems |^4|, |25| . 

For analyzing properties of large random networks, the 
cavity method approximately utilizes a message passing 
algorithm that exactly holds in the Bethe lattices under 
the assumption that the approximate treatment yields 
exact results for the random networks in the infinite sys- 
tem limit. Study on the Bethe lattices has a long history 
as one of few analytically solvable examples of perco- 
lation problems pq , and the equivalence between the 
infinitely large random networks and the Bethe lattices 
has been shown for many examples of disordered systems 
p5j . In this sense, our approach can be considered as an 
extension of such existing studies to advanced settings 
in which various combinations of failure/attacks in con- 
junction with degree-degree correlations are taken into 
account. 

As shown later, our approach reproduces results identi- 
cal to those obtained by the generating function method 
PH |l2[ in various cases. Although the methodological 
relationship has not been fully clarified yet, this implies 
that the two schemes are potentially equivalent. How- 
ever, the cavity method relies more highly on physical 
intuition and, therefore, may be easier to understand the 
physical meanings of relevant variables/equations that 
come out in the analysis. 

This paper is organized as follows. In the next section, 
we briefly review several notions and known results con- 
cerning random networks which were necessary for our 
research. In particular, concerning the robustness of the 
connectivity, the optimality of the two-peak model, which 
we focus on later, is mentioned in some detail. In Sec. 
Ill, we develop a scheme for assessing feature quantities 
of percolation based on the cavity method. In Sec. IV, 
we discuss the use of our scheme for advanced problems 
of the two-peak model, in conjunction with validation by 
numerical experiments. The final section is devoted to 
the summary. 



II. SHORT SUMMARY OF RANDOM 
NETWORKS 

In this section, we review several notions and known 
results concerning random networks. The models that 
we focus on are also introduced. 



A. Random Networks and Degree Distribution 

In general, a random network is composed of a collec- 
tion of sites (nodes/points) and bonds (edges/links) that 
randomly connect pairs of sites. The number of bonds 
connected to a particular site is termed the degree k of 
the site. 

Degree distribution p(k), which denotes the frequency 
of sites that have degree k in a network, is widely used 
for characterizing an ensemble of random networks. Con- 
versely, it is often required to generate random networks 
following a given specific degree distribution p(k). Let us 
denote di as the degree of index i(= 1,2,..., N), where N 
is the number of sites in the network. For k — 1,2,..., 
we set di = k for Np(k) indices of i = 1, 2, . . . , N. A 
pra ctical scheme for the generation is basically as follows 

(P) Make a set of indices U to which each index i at- 
tends di times. Accordingly, we iterate (C1)-(C3). 

(CI) Randomly choose a pair of two different elements 
from U. We denote the indices of the two elements 
as i and j. 

(C2) If i ^ j and the pair of i and j has not been chosen 
up to that moment, make a bond between i and j 
and remove the two elements from U. Otherwise, 
we return them back to U. 

(C3) If U becomes empty, finish the iteration. Other- 
wise, if it is not possible to make more bonds by 
(CI) and (C2), return to (P). 

Related to p(k), one sometimes has to deal with the 
probability that one terminal of a randomly chosen bond 
has a degree k, which is assessed as 

kp(k) 

= kp ^ m 
(k) [ > 

with use of the Bayes formula. Here, (k) = J2i^p(^) 
denotes the average of degrees on the random network. 

B. Degree-Degree Correlations 

In addition to the frequencies, one can also take cor- 
relations of the degrees into account for characterizing 
properties of random networks by using the joint degree- 
degree distribution r(k,l), which denotes a joint proba- 
bility that two sites directly connected by a randomly 
chosen bond in a given network have degrees k and 
I. We focus on homogeneously random networks, where 
r(k,l) = r(l,k) holds for arbitrary pairs of k and I. 

r(k, I) has more information than p(k) or in the 
sense that they are generally determined or reduced from 
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r(fc, I) in such a way that 

5>(M) = 



kp(k) 



(2) 



holds for Vfc. Moreover, r(fc, Z) is used for characterizing 
the degree correlations in random networks. In general, 
one can assess a conditional probability when one termi- 
nal site of a randomly chosen bond has degree I, the other 
terminal has degree k as 



r(fc,/) (k}r(k,l) 



n lp(l) 
from r(fc, I). Random networks, which satisfy 
rik = n Vfc, I, 



(3) 



(4) 



are generally regarded as uncorrelated or referred to as 
those of no degree correlations. 

Let us consider a situation in which we generate ran- 
dom networks following a given degree distribution p(k). 
Even if p(k) is specified, one can still control the de- 
gree correlations by designing conditional probabilities 
rki ■ The degree of freedom for such a design is assessed 
as 



F 



t(fcn 



1) 



k 2 - k 



(5) 



where fc ma x is the maximum degree in the network. This 
is because fc max positive values are assigned to rki to sat- 
isfy r k m = n k r k for Vfc,Z and J2i r ki r i = r k for Vfc, 
which yields fcmax (fcmax — l)/2 and fcmax constraints, re- 
spectively 

The network generation scheme mentioned in the pre- 
ceding subsection is not expected to produce any de- 
gree correlations. Many methods have been proposed 
for creating non-trivial correlations in random networks 
jl3], The scheme proposed in which we em- 

ployed for numerical experiments shown in the later sec- 
tions, generates random graphs so as to make the joint 
distribution of the remaining degrees j and fc of two ter- 
minal sites of a randomly chosen bond fit in a desired 
value ejk- The procedure of this scheme is summarized 
as follows: 

(I) For a given degree distribution p(k), generate a ba- 
sic graph by the algorithm shown in the preceding 
subsection. Accordingly, we iterate (D1)-(D3) suf- 
ficiently many times. 

(Dl) Choose two bonds denoted by pairs the terminal 
sites, (vi,wi) and {v2,W2), randomly. 

(D2) Evaluate remaining degrees (ji,fci) and (j2,fc2) of 
the above two sites pairs. 

(D3) Replace the bonds with two new site 
pairs (vi,V2) and (101,102) with probability 
min[l, {e nn e kl k 2 )/{ej 1 k 1 e ]2 k 2 )], 



where min(a;, y) denotes the smaller value of x and y. 
For macroscopically quantifying the degree-degree corre- 
lations, a measure 



R 



-y 



ejk - Qjqk) 



where 



Ik 



= J! k 2 q k - ( ^ k 1 

k k 
(fc + l)p(fc + l) 



is often used |0|. If R of the above equation is zero, 
the random network is entirely random. On the other 
hand, positive (negative) R indicates a tendency that the 
higher/lower-degree sites are more likely to be attached 
to other higher/lower-degree sites, the property of which 
is sometimes referred to as assortative ( disassortative ) 
mixing. 



C. Connectivity and Robustness 

We mainly explore the efficiency of connectivity of net- 
works. For this, let us define several notions concerning 
connectivity. 

We refer to two sites i and j as connected if and only if 
one can connect i and j by at least one sequence of bonds 
between them. Otherwise, the two sites are considered 
as disconnected. Given a network, a subnetwork in which 
any pairs of sites are connected is termed a connected 
subnetwork. In particular, a connected subnetwork that 
contains a majority of sites of the original network is 
often referred to as the giant component. 

When some sites and/or bonds are removed from 
the original network, the size of the giant component 
is reduced. Such removal can be regarded as corre- 
sponding to accidental/voluntary breakdown of machin- 
ery/connections in real- world networks. For theoretically 
assessing the robustness of network connectivity against 
such problems, we consider the following two sources of 
defects, random failure, which is modeled by statistically 
independent random removal of sites and/or bonds with 
certain probabilities and targeted attack, which is also 
dealt with as random removal of sites and/or bonds but 
only applied to sites whose degrees are larger than a cer- 
tain threshold value. 

Let us denote Wi as a probability that a site i does 
not belong to, or cquivalently, is not connected to a giant 
component when the networks are randomly constructed. 
The size of the giant component is characterized by 



S = N- 1 J2(l-W i . 



(0) 



When the networks are affected by the above defect 
sources (failures/attacks), the typical value of S is re- 
duced as the defects strengthen. The critical value at 
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which S vanishes is termed the percolation threshold, by 
which we measure the robustness of network connectivity. 



III. CAVITY APPROACH TO PERCOLATION 
ANALYSIS 



D. Two- Peak Random Networks 



Before closing this preparatory section, we mention two 
results about network robustness. 



Earlier independent studies ]22j and 23 reported that 
networks characterized by bimodal degree distributions, 
which are occasionally referred to as two-peak networks, 
are most robust against random failures or attacks to 
sites among random network ensembles that are charac- 
terized only by the degree distributions |3(J. Although 
both models are classified into the same category of two- 
peak networks, there is a difference between how the 
larger degree scales as the network size tends to infin- 
ity. 

Valente et al. (^|| explored conditions of optimal 
network configurations under the constraint that net- 
work degrees arc distributed in a bounded range k E 
] (0 < fc mi n < fcmax) keeping the average de- 
gree (k) a finite constant. They found that the optimal 
degree distribution against random failures is of the form 
that only p{k\) and p(k2) are finite while all other p(k)'s 
vanish, where k\ = fc m j n and (fc m i n <)k 2 (< ^max) is deter- 
mined in such a way that (k 2 ) is maximized while keeping 
(k) constant. 

On the other hand, Paul et al. |^3| presented another 
type of two-peak network, which is robust against both 
random failures and targeted attacks. They assume that 
smaller-degree sites (fci) are dominant in random net- 
works and a very small number of the larger-degree (k 2 ) 
sites, which they call "hub-nodes ", is inserted. Under 
the constraint that the number of sites N and the aver- 
age degree (k) are fixed, their finding indicates that the 
robustness is maximized when the following conditions 
hold M: 



ki 
k 2 
P(ki) 

p(k 2 ) 



(k), 

1-P(fe), 



' 2(fc) 2 ((fc)-f) 2 
. 2(fc) - f 



2/3 



/(k)N 



The networks become more robust for larger N. Note 
that k 2 in the above expression indicates the highest pos- 
sible degree allowed in a random network with average 
(k) and size N when no multiple bonds between identical 
pairs of sites are permitted [p2| . 

Hereafter, we refer to the former and latter as 
the Valente- Sarkar- Stone (VSS) model and the Paul- 
Tanizawa-Havlin-Stanley (PTHS) model, respectively 



In this section, we develop a scheme for analyzing the 
robustness of random networks against various proba- 
bilistic attacks/failures based on the cavity method of sta- 
tistical mechanics of disordered systems |24|, . Many 
existing studies on disordered systems indicate that the 
cavity method leads to the exact results in appropriate 
infinite system limits for various problems defined over 
random networks that are characterized only by a degree 
distribution j25j even when the support of the distribu- 
tion is not bounded J3^-|3^]. In addition, recent studies 
imply that the coverage of this method can be extended 
to cases in which non-trivial degree-degree correlations 
exist Therefore, we expect that our analysis 

shown below provides the exact results as well, the math- 
ematically rigorous proof of which is unfortunately diffi- 
cult. Instead, the validity of our scheme is shown by re- 
production of known results, which have been obtained 
using other schemes in earlier studies, and comparison 
with numerical experiments. 



A. Tree Approximation and Cavity Fields 

Let us develop an analytical scheme for evaluating the 
size of the giant component (Eq. (|J)) for assessing the 
network robustness. To do this, we first focus on a gen- 
eral property of randomly constructed networks, which 
is that lengths of closed paths between randomly chosen 
two sites (cycles) typically increase O(lnTV) as the size 
of networks TV tends to infinity as long as the variance 
of the degree distribution is finite p9| . This property 
is presumably unchanged in most cases even when the 
degree-degree correlations are introduced as such corre- 
lations decrease exponentially fast with respect to lengths 
of paths except for extreme cases. This naturally leads us 
to approximately evaluate Eq. (|^) by handling the local 
network structure of each site as that of trees, which are 
free from cycles. 

To explain this, we use the notation di to denote a 
set of site indices I that are directly connected to a site 
i. We also introduce an indicator cj_>j = or 1 in the 
i-cavity system that is defined by removing site i from 
the original system; cj_^ — and 1 indicate that I does 
and does not belong to a giant component of the i-cavity 
system, respectively. Such variables are generally termed 
cavity fields p4| , p5| . A general and distinctive feature of 
trees is that all sites I E di are completely disconnected 
from one another by removal of i. This means that when 
i is inserted in the i-cavity system, while keeping the 
connection to a site j E di, (ij), is removed, the indicator 
that i does not belong to the giant component is assessed 
as ri;eaj\j c z-hj where X\j denotes removal of j from a 
set X. However, i and j are connected (a pair) through 
only the bond of {ij} when the original system is a tree, 
this represents nothing but the cavity field of i in the 
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j-cavity system (see the left figure of Fig.l). This yields 
the equation 



ledi\j 



(7) 



By moving entirely over the network, this equation can 
determine all the cavity fields q_>.j given appropriate ini- 
tial and boundary conditions. After determining the cav- 
ity fields, the indicator that i does not belong to a giant 
component of the original system, o.j, can be evaluated 
as 



ledi 



(8) 



by taking the influences from all neighboring sites into 
account (the right figure of Fig.l). 



B. Macroscopic Description 

The following issue plays a key role for furthering our 
analysis. Let us classify sites in a graph by degree fc, and 
denote uj- as the frequency that the binary cavity fields 
ci^i of sites i of degree k take the value of 1. Namely, Uk 
is defined as u k = (£\ S^^k)' 1 J2i ( S \d*\,kJ2iedi c i^)> 
where \di\ stands for the degree of the site i and 5 x>y = 1 
if x = y and 0, otherwise. As N — > oo, we can expect 
that Uk typically converges to its average with respect 
to generation of graphs. Such property is generally re- 
ferred to as self- averaging [p4[ . In the current problem, 
the probability that a site neighboring a site of degree k 
has a degree m is denoted as r mk ■ Under the tree approx- 
imation, the influences of the cavity fields from the neigh- 
boring sites can be averaged independently with respect 
to the graph generation. These mean that the algorithm 
of Eq. (H) can be macroscopically described as 



Uk 



E 



(rikUi) 1 (r 2 ku 2 ) 



fc-i 



E 



(9) 



where Y2\ represents £ ; £ ; • ■ ■ under the restriction of 
£ t Z t = fc-l. 

We assume that effects of random failures and/or tar- 
geted attacks can be taken into account by random re- 
moval of sites and/or bonds. For this, we denote s m 
and b m k as removal probabilities of sites of degree m 
and bonds connecting two sites of degree m and k, re- 
spectively. Suppose that under such an environment of 
random removal, a site i is not connected to the giant 
component through the bond (li) from a neighboring site 
I £ di\j when i is inserted into the i-cavity system. For 
this, at least one of the following three holds: 

(1) I is not connected to the giant component. 



(2) I is removed. 

(3) The bond (li) is removed. 

This indicates that u m in the right hand side in Eq. (|^) 
should be replaced by 1 — (1 — s m )(l — b m k)(l — u m ) 
assuming that the degrees of sites j and i are m and fc, 
respectively. Substituting this into Eq. (^) finally yields 
a set of equations for determining the frequencies of the 
cavity fields 



Uk 



= (l - y"V TO fc(l - Sm)(l - b mk )(l - U rn ) 



k-1 



(10) 



in a self-consistent manner. 

Let us denote Wk as the probability that a site of de- 
gree k is not connected to the giant component, which 
means that Wi = Wk for a site i of degree k. By averaging 
(X^l^l.fc) -1 J2i S \di\,kOi with respect to the graph gen- 
eration and random (possibly degree-correlated) removal 
of sites/bonds, this is assessed as 



Wk 



1 -E r ^fc(l ~ S ™)(1 - b mk )(l - u m )j , (11) 



after determining Uk for Vfc = /c m ; n , . . . , fc max by the 
above set of equations. Consequently, the size of the 
giant component is evaluated as 



k 



p(k){l-s k )(l-w k ). 



(12) 



These expressions constitute the main result of the cur- 
rent study. 



C. Validation by Reproduction of Known Results 

Equations ( |Io|) and ([ll]) generally hold for random net- 
works characterized by a joint degree-degree distribution 
r(m, k). However, since the way of derivation and the ob- 
tained expressions are somewhat different from those of 
known analyses, it is not clear how our scheme is related 
to earlier studies. To clarify the relation, we first repro- 
duce known results on the giant components for three 
basic examples using our developed scheme. 



1. Random, Failures on Uncorrelated Random Networks 

We first focus on uncorrelated networks, which are 
characterized by r m k = rk for Vm, k. When b m k does 
not depend on the degrees of sites (b m k = b m ), we can 
rewrite Eq. ( |To| ) as follows 



Uk 



1 - E ? * m ( 1 _ S ")(l ~ & ™)(1 _ U m) 

m 

(i-u) k - 1 Vfc 



fe-i 



(13) 



6 




c, 




< 



Cj 



FIG. 1. Schematic diagram of computation in cavity method. The squares k, I, m, and j denote sites in the i-cavity system. 
The left figure corresponds to Eq. (g). c/t_>i, and c m ^i represent the cavity fields passed to i when i is inserted in the 

i-cavity system. By keeping the bond between i and j out, they compose the cavity field of i in the j-cavity system, Ci_>j. 
After determining all cavity fields coming into i, Oi is assessed, following Eq. (W) (the right figure). 



where U = E m r m (l - s m )(l - b m )(l -u m ). This yields 
a self-consistent equation of U as 



U = J2 r rnf m (l-(l-UY 



(14) 



where f m is a product of fractions of site and bond fail- 
ures (1 — s m )(l — b m ). This means that the size of a 
giant component S on a random network without degree 
correlation can be expressed using U as 



S 



i-*)5>(*)[i-(i-to* 



(15) 



where p(k) is a degree distribution of the random net- 
work. This expression is identical to the one obtained in 
earlier studies (for example [pd|). 

Equation ( |l5| ) can be used for assessing a percolation 
threshold of an uncorrelated random network. For ran- 
dom failures of sites and bonds on random networks, f m 
does not depend on degrees to of sites; therefore, 



/ 



U 



Z m rm(l-(1-U) m - x ) 



(16) 



holds. This expression means that the giant component 
disappears when U vanishes. Therefore, we take a limit 
U — > in the above expression and use l'Hopital's rule, 
which yields the percolation threshold as 



1 



T,m r m{m- 1) 
1 



(17) 



- 1 



This also agrees with the one obtained in earlier studies 
(for example pjfl). 



2. Targeted Attacks on Uncorrelated Networks 

For the second example, let us assess the size of a giant 
component and the percolation threshold of uncorrelated 
networks against targeted attacks. For this, we assume 
that 



, _ J b m , m > to', 
° mk ~ \ 0, to < to', 



(18) 



which implies that the attack is targeted to only larger- 
degree sites. Let us denote f a and f r as rates of targeted 
attacks and random failures, respectively. When f r = 
or there is no attacks to sites and/or bonds of degree 
to < m', we have an expression 



fa 



£ M r M {l-(l-tf)M-i } 



(19) 



where = EkLn and = Em'+r Taking a limit 
of [/ — > yields the percolation threshold as 



l -Y,m r m{m-l) 

Em<"m(M-1) 



(20) 



There could be cases where random networks still have 
giant components if all larger-degree sites are removed 
or f a = 0. In such cases, the percolation threshold of 
random failures after targeted removals is evaluated as 



fr, 



1 



J2m r m(m- 1) 



(21) 



To evaluate the size of the giant component of random 
networks of no degree correlations, we rewrite Eq. ( |l5| ) 
to make s in Eq. ( fl5"| ) depend on k as Sfc, which offers an 
expression 



s=5>(*)(i-«*)(i-(i-E0' 



(22) 
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3. Degree- Correlated Networks 

For the final example for validating our scheme, we 
analyze random networks of degree correlations against 
random failures. Unfortunately, it is difficult to obtain 
analytical expressions of thresholds for degree-correlated 
networks in the case of correlated networks. However, 
one can still numerically evaluate the threshold by solving 



w k = (i- yy ro fc(i - s)(i - &)(i - u m ) 

m 

U k = {} - X^ ro fc(l _ S )( 1 _ fo )(l _ Um ) 



fc-1 



(23) 

(24) 
(25) 



which is computationally feasible. 

One can use Eqs. ( pd| ) and ([!(]) to assess the per- 
colation threshold due to bond attacks as follows. Let 
/ = (1 - s)(l - 6) and y k = 1 - u k . This and Eq. @ 
yield an expression 



i-» = (i-/E 



^mkUm 



k-1 



(26) 



Near the percolation threshold, y k -C 1 holds, which 
makes it possible to expand the left hand side of the 
above equations 



Vk 



/J^(fc-l) 



(27) 




FIG. 2. (Color online') Sizes of giant component assessed us- 
ing Eqs. ( |lo| ) and (jl^) for two-peak random networks that 
suffer from random failures, s is a probability of site removal. 
The solid red curve shows the theoretical prediction for the 
optimized two-peak random network (ki — 4, k^ — 200) of 
R ~ (uncorrelated, solid red curve). Those for ki = 4 and 
&2 = 10 of R w —0.1 (short-dashed green curve) and i? « 0.2 
(long-dashed blue curve) are also shown for comparison. The 
markers represent the results of numerical simulations, which 
are in good agreement with the theoretical predictions. 



and express them in a matrix form, 
y = A/y, 

where 



(28) 



The percolation threshold is determined by the condition 
that Eq. ( Pq) has a nontrivial solution. This is reduced 
to the eigenvalue analysis of the matrix A, and, in gen- 
eral, the largest eigenvalue corresponds to the percolation 
threshold. 

To confirm the validity of our analytical scheme, we 
compared the size of the giant component predicted us- 
ing Eq. (^5j) with the results of numerical experiments. 
The experiments were carried out for the two-peak net- 
works of k\ = 4 and &2 = 200, which were designed to 
have an average degree of 4.4702. The network size was 
set to N — 10000. The configuration was obtained by 
optimizing networks based on the procedure proposed 
by Valente et al. Q under restrictions of k min = 4, 
fcmax = 200, and (k) = 4.4702. The identical config- 
uration was also yielded using an optimization scheme 
proposed by Paul et al. 



23 



constraints of ki = 4 and N 



for random failures under 
= 10000. In addition to 



the optimized two-peak random network, we also per- 
formed experiments for non-optimal two-peak networks 
of k x = 4, fc 2 = 10, (k) = 4.4702, and N = 10000 for 
comparison. 

For two-peak networks, the joint distribution of the 
remaining degrees, ej k , is uniquely determined when the 
network correlation R is given in conjunction with degree 
distribution p(k). Therefore, we controlled R employ- 
ing the scheme proposed by |l3| , which is summarized 
in Sec. II B., to the basic graphs constructed by the al- 
gorithm shown in Sec. II A. Analytically assessing the 
conditional degree distribution r mk for a given set of ej k 
is difficult. Therefore, we experimentally assessed r mk 
from the resulting networks and applied them to Eqs. 
( f23| ) and ( pi] ) for evaluating the theoretical prediction of 
S. The values of the theoretical prediction numerically 
accord with those offered by an earlier study ]I3 in high 
accuracy, although their methodological relation has not 
been clarified yet. 

Figure || shows the size of the giant component ver- 
sus random failures of two-peak random networks opti- 
mized according to earlier studies and others to compare 
with the optimized ones. This indicates that networks 
become more robust as the degree correlation R is in- 
creased, which has been pointed out by Newman fl3|]. 
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IV. ANALYSIS OF ADVANCED SETTINGS: 
CORRELATED ATTACKS FOR CORRELATED 
TWO-PEAK NETWORKS 

In this section, we show the utility of the developed 
scheme by application to advanced settings, which, as far 
as we know, have never been explored in earlier studies. 
More precisely, we consider problems of targeted removal 
of sites or bonds in two-peak random networks with de- 
gree correlations. A distinctive advantage of our scheme 
is the direct applicability to cases of correlated attacks 
and/or correlated networks, which was somewhat tech- 
nically difficult in earlier studies. We use this advantage 
to examine how the degree-degree correlations affect the 
network robustness of two-peak random networks, which 
have been shown as optimal against both random failures 
and targeted attacks in the case with no degree-degree 
correlations. 



A. Unified Treatment of Degree-Correlated Defects 

With regards to advanced settings in our scheme, let us 
consider situations in which targeted sites or bonds are 
removed in correlated two-peak random networks. We 
introduce the notation f mk to denote (1 — Sfe)(l — b m k)- 
Using this, Eq. din) is expressed as 



ui 



fl — r m if„ d (l - u m )j 
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FIG. 3. (Color online) Percolation thresholds concerning site 
attacks s c versus degree correlation R. The solid (red) and 
dotted (blue) curves represent the percolation thresholds of 
the PTHS and VSS models, respectively. In the inset, the 
same data near R — are enlarged. The two curves intersect 
at R = 0. The reason why the data for the PTHS model 
is limited to a small region of R is that the number of sites 
with = 200 degree is so small that it is difficult to broadly 
change R. 



which yields 

By = y (30) 
for the matrix expression (p8[), where 

B m k = A m kfmk- (31) 

The percolation threshold again corresponds to a critical 
set of probabilities f m k, which corresponds to a nontriv- 
ial solution of the above equation. This indicates that 
we can evaluate the percolation threshold by numerically 
solving 

det[B - E] = 0, (32) 
with respect to f m k and adopting one of the solutions. 

B. Degree-Correlated Site Attacks 

In general, there are multiple solutions that satisfy the 
above equations. However, we can still obtain analyt- 
ical expressions of the percolation threshold by impos- 
ing some restrictions for the two-peak random networks. 
As one example, let us consider the cases where larger- 
degree sites are attacked preferentially under the con- 
straint that the rate of site failures over all sites is fixed 



to a given value s. In such cases, we can generally set 
fa = /feifea = fk 2 k 2 and f r = f klkl = f k2kl . These pa- 
rameters are related with s as 

f(l-/„)p(fe), 0<s<p(k 2 ), 
\p(k 2 ) + (1 - f r )p(h), s>p(k 2 ). ' 

The first case of < s < p(k 2 ) in Eq. (|3^) implicates 
situations where only a portion of larger-degree sites suf- 
fers from the attacks, whereas the other portion and all 
smaller-degree sites are not damaged. In this case, Eq. 
( |32| ) yields the percolation threshold as 

The other case of s > p(k 2 ) corresponds to situations 
where a giant component exists despite the fact that all 
larger-degree sites are removed, for which Eq. ( |32| ) offers 
the percolation threshold as 

s c =p(k 2 )+(l-^-)p(k 1 ). (35) 

Figure ^ shows the percolation thresholds assessed for 
the VSS and PTHS models, which are reviewed in Sec. 
II D. The VSS model has a network configuration with 
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FIG. 4. (Color online) Percolation thresholds concerning 
bond attacks b c versus degree correlation R. The solid (red) 
and dotted (blue) curves represent the percolation thresholds 
of the PTHS and VSS models, respectively. The percolation 
threshold of the PTHS model decreases as R increases. The 
reason why the data for the PTHS model is limited to a small 
region of R is identical to that of Fig. N 



FIG. 5. (Color online) Sizes of giant component versus tar- 
geted site attacks. The sizes of the giant component are plot- 
ted for the PTHS model with R « (analytical results: solid 
red line/numerical simulation: circles) and the VSS model 
with R « 0.4 (dashed blue line/squares) and R ~ —0.8 (dot- 
ted green line/diamonds). The network size for the numerical 
simulation is N = 10000. The error bars are smaller than the 
markers. 



ki = 4, k 2 = 5, which is obtained using the optimiza- 
tion procedure of Valente et al. p2| ] concerning tar- 
geted attacks on sites under the restriction of fc m ; n = 4, 
/c max = 200, and (k) = 4.4702. On the other hand, the 
PTHS model has a network configuration with ki = 4, 
k 2 = 200, and (k) = 4.4702, which is offered with the 
optimization method proposed by Paul et al. |23| under 
the restrictions of ki = 4 and TV = 10000. 



In the two-peak models, Eq. (21) guarantees that the 
value of the percolation threshold is identical between 
the two models for R = 0. Earlier studies showed that 
the percolation thresholds concerning random failures on 
sites and bonds increase as R increases for both models, 
implying that the assortiveness makes the network more 
robust against such failures. Figure || indicates that this 
is the case for intentional site attacks as well. For all 
cases of the VSS model, the percolation threshold s c is 
determined by the second case in Eq. (|33|); namely, the 
giant component can be sustained even if all larger-degree 
sites are removed. However, for the PTHS model of suffi- 
ciently low i?(< —0.27), the giant component disappears 
only by removing a certain number of larger-degree sites. 
When R is lower than zero, two sites of different de- 
grees are more likely to be connected. This implies that 
larger-degree sites act like glue in forming a network of 
smaller-degree sites. Constituents of the network would 
be disconnected if the glue were removed. This may be 
the reason the giant component disappears by only re- 
moving a portion/certain number of larger-degree sites. 



Figure || also indicates that the affect of R is more sig- 
nificant in the VSS model than in the PTHS model. This 
might be understood as follows. In the PTHS model, 
the number of sites with degree k 2 , Np(k 2 ), grows as 
0{N 1 / i ). It is much smaller than that of bonds, which 
are directly linked to the sites, k 2 Np(k 2 ) ~ 0(N 3 / 4 ). 
Even if R is tuned, this prevents the sites from seg- 
regating from sites with degree ki and, therefore, the 
configuration of the network will not change drastically. 
This is in accordance with the profile of the percolation 
threshold in Fig. [|, which exhibits a weak dependence 
on R. In contrast, the numbers of sites and bonds for 
a larger degree k 2 are comparable in the VSS model as 
Np(k 2 ) ~ O(N) and k 2 Np{k 2 ) ~ 0(N) hold. This in- 
dicates that the larger-degree sites can form almost in- 
dependent networks by themselves, separating from sites 
with degree ki when R is set to a sufficiently large pos- 
itive value. On the other hand, if R is set to a negative 
value, connections of sites of the two different degrees are 
enhanced. These mean that the profile of the network is 
highly affected by the regulation of R, which may lead to 
a relatively strong dependence of the percolation thresh- 
old on R in Fig. 0. 
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FIG. 6. (Color online) Sizes of giant components versus tar- 
geted bond attacks. The sizes of the giant component are plot- 
ted for the PTHS model with R m (analytical results: solid 
red line/numerical simulation: circles) and the VSS model 
with R ~ 0.4 (dashed blue line/squares), and R ~ —0.8 (dot- 
ted green line/diamonds). The network size for the numerical 
simulation is iV = 10000 as well as the simulation in Fig. |^ 
The error bars are smaller than the markers. 



C. Degree-Correlated Bond Attacks 

For another example, we consider a situation in which 
the attacks are preferentially launched on bonds connect- 
ing to larger-degree sites under the constraint that the 
rate of failures over all bonds is fixed to b. We set 

fa = fk 2 k 2 and f r = f klkl = fkaki = /feifca as we did 

in the analysis on site attacks. This yields an expression 



f(l-/oM*2,fca), 0<b<r(k 2 ,k 2 ), 
\r(k 2 ,k 2 ) + (1 - f r )(l-r{k 2 ,k 2 )), b > r(k 2 ,k 2 ). 

(36) 

The first case of < b < r(k 2 ,k 2 ) in Eq. (^6|) implies 
situations where only a fraction of bonds connecting two 
larger-degree sites suffers from attacks, whereas all the 
other bonds are not damaged. In this case, Eq. ( p^ ) 
yields the percolation threshold as 



b B = 



(A n - 1)(A 22 - 1) - A 12 A 21 



A 22 (A 



li 



1) 



r{k 2 ,k 2 ). (37) 



The other case of b > r(k 2 , k 2 ) corresponds to situations 
where a giant component exists even when all bonds con- 
necting two larger-degree sites are removed, for which Eq. 
13) offers the percolation threshold as 



where 



' 2A 12 A 21 + An - yJA{ x + 4A 12 A 21 
2A 12 A 21 



(39) 



r(k 2 ,k 2 ) +b rc [l - r(k 2 ,k 2 )}, 



(38) 



Figure [| indicates that the VSS model is not as ro- 
bust as the PTHS model. This may be understood as 
follows. In bond attacks, bonds connecting two sites of a 
larger degree k 2 are removed preferentially. In the PTHS 
model, the number of the sites of degree k 2 is much less 
than that in the VSS model. This implies that the bonds 
that suffer from these attacks are relevant only to such 
a small number of sites in the PTHS model and, there- 
fore, the damage on such bonds will not significantly de- 
teriorate the total efficiency of the network connectivity 
compared to the case of the VSS model. Another dis- 
tinctive feature is that the percolation threshold of the 
PTHS model decreases as R increases. When R is set 
to a negative value, the number of bonds that link two 
nodes of different degrees increases. This decreases the 
number of bonds linking two larger-degree sites, which 
will work as a factor of deterioration of the percolation 
threshold. However, at the same time, the increase in the 
number of bonds connecting two sites of different degrees 
will enhance the network connectivity. The dependence 
of the percolation threshold on R implies that this effect 
overcomes the deterioration factor in the PTHS model. 



D. Numerical Validation 

For justifying the results obtained in this section, we 
performed numerical simulations for the two types of two- 
peak-correlated random networks. The procedures for 
generating these random networks are the same as those 
mentioned in Sec. Ill C. 

Figures ^| and ^| show the size of the giant component 
against targeted attacks on sites and bonds, respectively, 
for the PTHS and VSS models of N = 10000. The con- 
figurations are identical to those mentioned in Sec. IV 
B. One can find that analytical results obtained with our 
scheme agree with those from numerical simulations with 
high accuracy. 

In these figures, changes in R cause little notable differ- 
ence as long as the situation is set far from the percolation 
threshold. However, the figures also indicate that the gi- 
ant component generally decreases as R increases. In 
addition, there is a tendency that a network with higher 
robustness has a smaller giant component at moderate 
number of removals. This indicates that we should pay 
attention not only to the percolation threshold but also 
to the size of the giant component when we want to con- 
struct a robust network. 



V. SUMMARY 

We have developed a scheme for analyzing random 
networks characterized by arbitrary degree distributions 
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based on the cavity method of statistical mechanics of 
disordered systems. By approximately regarding the lo- 
cal structure of a given network as a tree, one can con- 
struct an approximation method for assessing the prob- 
ability that a site does not belong to the giant com- 
ponent, which is the largest connected subnetwork of a 
random network. The most distinctive advantage of the 
scheme is the wide applicability against various types of 
attacks and failures that are intended for sites and/or 
bonds, which holds even in the presence of degree correla- 
tions. The validity and usability of the scheme have been 
shown by comparing it with known results and applying 
it to analysis of site/bond attacks in degree-correlated 
networks of bimodal degree distributions (two-peak net- 
works) in conjunction with numerical justification. 

Promising future works include assessment of robust- 



ness against bond attacks for more realistic networks. 
Generalizing our approach to multi-bond and/or directed 
networks may also be of interest. 
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